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THE  VIEW,  OPINIONS.  AND/OR  FINDINGS  CONTAINED  IN  THIS  REPORT  ARE 
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Results  of  ARO  DAAG2 9  -  8 5 -K- 0 2 5 0 


Automated  S t e r eo pho t o g r amme t r y 


The  Spatial  Data  Analysis  Laboratory  has  developed  a  pattern 
recognition  approach  to  window  matching  in  the  aerial  stereophoto- 
grammetry  problem.  In  essence,  an  oriented  graph  based  on  edge 
vectors  is  extracted  from  the  photopair  and  corresponding  topolog¬ 
ical  features  --  nodes  --  are  tested  for  match.  To  facilitate  the 
topological  analysis  the  graphs  are  generated  on  a  pseudo- 
hexagonal  taster 

The  results  of  ARO  DAAG2  9  -  8 5 - K- 0 2 S 0  ,  "Automated  Stereophoto- 
grammetry  were  very  encouraging  In  particular,  with  a  slow  image 
processing  environment  (GIPSY  on  VAX  11/785)  a  dense  network  of 
matched  points  was  obtained  at  the  rate  of  5  points/s,  vs  15 
points/s  at  ETL  on  a  Cyber-730. 

The  results  of  the  two  algorithms  are  very  similar  at  most 
points.  On  the  Cyber-730  ETL ' s  routine  provides  a  match  rate  of  15 
pts/sec,  not  including  the  time  for  the  interactive  priming 
matches.  Our  algorithm,  running  on  the  Vax-11/785,  produces  a 
match  rate  of  5  pts/sec  Considering  the  machine  differences  and 
the  additional  time  for  interactive  matching,  we  estimate  that  our 
algorithm  is  at  least  an  order  of  magnitude  faster  than  the  one 
currently  used  at  ETL.  But,  more  importantly,  it  does  not  require 
the  tedious  priming  of  initial  matches 

The  present  approach  uses  a  pattern  recognition  technique  to 
reduce  the  volume  of  c r o s s - c o r r e 1  a t i on  computation  Essentially, 
the  algorithm  constructs  a  pair  of  oriented  graphs  representing 
visual  edges  in  the  original  aerial  photopair  and  then  determines 
corresponding  topological  features  in  the  two  graphs. 

The  algorithm  needs  to  be  tested  on  further  image  pairs  of 
varied  nature  (urban,  rural,  jungle,  etc  Pattern  features,  i  e  , 
nodes  in  the  directed  graph  generated  by  the  algorithm,  can  be 
utilised  for  detection  and  recognition  of  man-made  objects  on  the 
ground.  This  was  not  investigated  in  the  research  just  concluded 
The  present  proposal  covers  these  points,  among  others 

Furthermore,  future  work  on  the  algorithm  itself  could 
involve  applications  to  computer  vision  in  general  In  particu¬ 
lar,  this  could  lead  to  vision  systems  for  self-guided  robot 
vehicles. 


Outline  of  the  Algorithm 


Preliminary  work  was  done  by  Nadler  and  Signor  [19773  on  an 
orthogonal  array.  In  this  study,  their  work  was  translated  to  the 
hexagonal  array  and  several  refinements  were  made  to  the  algo- 
r  i  t  hro  . 

The  present  algorithm  almost  completely  automates  the  ste¬ 
reophot  o  g  r  amme  t  r  y  process.  It  does  require  some  preliminary  coarse 
manual  matching  to  choose  the  initial  resolution  on  the  digital 
gray-scale  images  and  to  roughly  align  them,  but  it  does  not 
require  any  interactive  matching  to  obtain  initial  offsets  The 
algorithm  refines  the  disparity  map  by  matching  corresponding 
topological  features  at  successively  finer  resolutions 

The  steps  in  the  algorithm  will  be  illustrated  by  figures 
taken  from  Brookshire's  thesis  119871  (the  figure  numbers  are 
those  in  the  thesis;  not  all  the  figures  from  the  thesis  are 
reproduced  here) 

Figure  1  shows  a  gray-sale  reproduction  of  a  digitized  ste¬ 
reopair  of  aerial  photographs,  taken  over  mountainous  terrain  At 
mid-right  can  be  seen  a  river  running  from  north  to  south.  The 
outline  of  the  algorithm  for  four  resolutions  (18x18  pixels  aver¬ 
aged  into  1  pseudo-pixel,  6x6,  2x2,  and  the  final  f u 1  1  - r e s o 1 u t i on 

analysis  using  individual  pixels)  follows 

Figure  3  gives  the  steps  in  the  basic  algorithm,  repeated  at 
each  of  the  resolutions  except  the  final  one.  We  now  consider  the 
major  steps  in  that  algorithm. 

Figure  7  shows  the  construction  of  the  p s e ud o -h e x a go na 1 
tilings  Here  the  heavy  lines  represent  the  consolidated  pseudo¬ 
pixels,  the  dashed  lines  the  original  pixels  of  the  digitized 
image,  where  the  consolidated  pixels  are  simply  the  averaged  gray 
values  of  the  original  pixels  entering  into  them  The  reason  for 
using  the  pseudo-hexagonal  tiling  is  for  its  topological  proper¬ 
ties.  It  has  the  same  connectivity  properties  as  a  true  hexagonal 
tiling  CColay,  19691 

Figure  8  shows  the  edge-vector  calculation  In  Brookshire's 
work  the  vectors  were  obtained  from  the  derived  orthogonal  compo¬ 
nents;  in  the  future  they  will  be  generated  directly  from  the 
pseudo-hexagonal  array.  In  the  next  steps  the  full  edge-vector 
field  is  filtered  using  thresholding  and  association  IBowker, 

1974,  Nadler  and  Signor,  19771,  to  obtain  a  noisy  oriented  graph 
representing  the  principal  features  visible  at  the  given  pseudo¬ 
hex  resolution  (Fig.  9) 

The  oriented  graphs  are  then  examined  for  singular  points 
--  "nodes"  (Fig.  12).  Because  of  an  initial  rough  alignment  of 
the  two  images  and  the  successive  refinement  of  the  coordinate 
grids,  using  the  disparities  found  at  preceding  resolutions,  cor¬ 
responding  nodes  are  never  very  far  from  each  other  in  the  current 
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coordinate  systems.  Thus,  for  each  pair  of  candidate  matching 
nodes  the  full  vector  field  in  a  small  window  about  these  nodes 
can  be  analysed  to  verify  if  there  is  an  actual  match  or  not. 

Figure  1?  represents  the  pseudo-hex  images  of  the  terrains  of 
Fig.  1  at  resolution  18x18.  The  full  edge-vector  field  obtained 
from  the  left  image  is  shown  in  Fig.  20.  After  filtering,  we  have 
the  noisy  oriented  graph  of  Fig.  22,  with  the  nodes  indicated  by 
the  small  squares  in  Fig.  23.  Finally,  nodes  with  confirmed 
matches  are  indicated  by  the  small  circles  in  Figs.  24,  25 

After  calculation  of  the  disparities  and  interpolating,  we 
have  the  contour  plot  of  Fig.  27.  This  is  to  be  compared  with  the 
corresponding  plots  at  resolution  6  (Fig.  32)  and  full  reoslution 
(using  gray  .ale  correlation  matching).  Fig.  33  For  comparison, 
Fig.  34  sho.jj  the  contour  map  of  the  same  area  from  ETL  .  A  pair 
of  3-d  plots,  the  SDAL  result  above  and  the  ETL  result  below  is 
given  in  Fig.  35.  They  are  very  close,  but  the  fractal  appearance 
of  the  SDAL  plot  may  indicate  that  it  hews  closer  to  the  actual 
terrain. 


Figure  1.  A  Stereo  Pair  of  Aerial  Photos 
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Figure  3.  The  Basic  Algorithm:  these  steps  are  applied 
at  each  pseudo-hex  resolution  level 
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Figure  8.  Edge-Vector  Calculation 
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Figure  12.  Examples  of  Nodes 
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Res  18  Matches  on  Left  Image 
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Figure  24.  Matches  on  Image  1 
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Res  18  Matches  on  Riqht  Image 
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Figure  25.  Matches  on  Image  2 
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CONTOUR  AFTER  RES  18 
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Figure  27.  Contour  Plot  after  Res  18 
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CONTOUR  RFTER  RES  6 
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Figure  32.  Contour  Plot  after  Ret  6 
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Flguro  33.  Tho  Final  Contour  Plot 
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ETL  CONTOUR 
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Figure  34.  Ths  Calculated  Contour  from  ETL 
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